REMARKS 



The applicants have amended the claims to put them into condition for 
allowance, in view of the amendments and the foiiowing reasoning for allowance, 
the applicants hereby respectfully request further examination and reconsideration 
of the subject application. 

A- The Response to Applicant's Arguments 

The Examiner stated that the Applicant's arguments filed March 6, 2007 have 
been fully considered but were not persuasive because the requirement that the 
distance D is non-zero is not presented in the claims. However, this assertion is 
incorrect, because Claim 22 specifically calls out that the distance between virtual 
centers is non-zero. Hence, the applicants believe that the final rejection of the 
claims is premature. 

In fact, it is well settled that MPEP 707.07(f) states that "where the applicant 
traverses any rejection, the examiner should, if he or she repeats the rejection, take 
note of the applicants' argument and answer the substance of it." The claims (at 
least Claim 22) does call out a non-zero distance between virtual centers of 
projection, The applicants request reconsideration of the applicants' arguments 
and that the final rejection be withdrawn. As explained in M.P.E.P. 708.07(d), "If, on 
request by applicant for reconsideration, the primary examiner finds the final 
rejection to have been premature, he or she should withdraw the finality of the 
rejection. The finality of the Office action must be withdrawn while the application is 
still pending," 

Furthermore, the Office Action stated that "the same virtual center would 
mean a small distance between virtual centers". The applicants respectfully submit 
that this assertion is not correct. The same virtual centers would mean that the 
distance between the virtual centers is zero — that the virtual center of projection is 
identical for each camera. A small distance between the virtual centers of 
projections means that the distance between virtual centers is non-zero. However, 
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the applicants have amended the independent claims to provide for the non-zero 
distance between virtual centers of projection. Although this limitation does not 
change the meaning of the claims, it is beiieved that this additional limitation makes 
the claims patently distinct. Note that since independent Claim 22 already stated 
the non-zero distance limitation, no new issues are created by the inclusion of this 
term in the independent claims. Furthermore, the small distance between the virtual 
centers of projection is defined so as to provide minimal parallax error at a 
predefined distance from the cameras. This argument was also not addressed 
previously. 

B. The 35 USC 132(a) Objection to the Specification and the Obj ection to 
the Drawings 

The applicant hereby withdraws the drawing changes submitted on March 6, 
2007, and cancels the amendment to the specification submitted on this date which 
was alleged to be new matter to restore both the specification and drawings to their 
original state. The applicants note that the original equations for the exemplary 
embodiment are approximations for the equations that were submitted on March 8, 
2007. No admission is made that this previous amendment is new matter. 

C. The 35 USC 102(e) Rejection of Claims 1-3, 5-9, 13, 14 . 17, 19, 20, 22 and 
23^ 

Claims 1-3, 5-9, 13, 14, 17, 19, 20, 22 and 23 were rejected under 35 USC 
102(e) as being anticipated by Nalwa, U.S. Patent No. 6,128,143, herein after referred 
to as Nalwa. It was contended in the above-identified Office Action that Nalwa teaches 
all the elements of the rejected claims. The applicants respectfully disagree with this 
contention of anticipation. 

The applicants' claimed Invention is a camera system that uses N cameras 
and an N sided mirror to capture images of the surrounding scene. The images 
from the N cameras are stitched together to create a 380-degree panorama using a 
calibration surface. The camera system uses the N-sided mirror to create a 



camera array with a very small distance P between the virtual centers of 
projections of the c ameras i n the array. This distance D is a non-zero value. 
The distance is selected so as to provide m inimal par allax error at a 
predefined distance from th e cameras, it is not necessary to have an identical 
center of projection, or virtual center of projection, if the distance between the 
camera and objects of interest is restricted. This is the case in most video- 
conferencing applications where the size of the conference room fable, and typically 
the conference room, is limited. By using domain knowledge of the typical 
conference room table size and so relaxing the constraint of the distance D between 
adjacent camera's virtual centers of projection, the total camera system size can be 
made significantly smaller. A smaller camera is desirable as it becomes less 
obtrusive and is less expensive to build. The applicants' claimed invention employs 
this principle to create a small camera system that can be used for video 
conferencing. (Summary, emphasis added) 

In contrast, Nalwa teaches a camera system comprising an N-sided reflective 
surface (40) and N cameras (52, 54, 55 and 58). Nalwa teaches that t he cameras 
are aligned so that the have the same virtual center, as cited by the Examiner 
on page 2 of the Office Action, last paragraph. 

Nalwa does not teach the applicants' claimed N cameras each associated 
with a different side of an N-sided reflective surface, and a ligned to have a small 
distance between virtual centers of projection relative to eac h other which 
provides m inimal parallax error at a predefine^d.distancejrom the cameras. If 
each camera had an identical virtual center of projection, as is the case in Nalwa, it 
would be necessary to use large mirrors. Large mirrors are undesirable for video- 
conferencing purposes as the camera array should be very small and unobtrusive 
when it sits in the center of a conference room table. 

A prima facie case of anticipation is established only when the Examiner 
shows, inter alia, that the cited reference teaches each of the claimed elements of a 
rejected claim. In this case, the Nalwa reference does not teach the advantageous 
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features of the applicants' claimed invention such as the applicant's claimed "N 
cameras each associated with a different side of said N~sided reflective surface, and 
aliened t o have a small non-zero distance between virtu al center s of projection 
relative to each ot her which proxijM..ffliPl ri !j^!- P ara ^ ax error at a oreJ^fhvyJ 
distance from the cameras" which allows for the creation of a small and 
unobtrusive camera for video conferencing using small mirrors. Thus, the rejected 
claims recite advantageous features that are not taught in the cited art, and as such 
a prima facie case of anticipation is not established. It is, therefore, respectfully 
requested that the rejection of Claims 1-3, 5-9, 13, 14, 17, 19, 20, 22 and 23 be 
reconsidered based on the exemplary novel claim language: 

"A camera system comprising: 

an N-sided reflective surface that reflects its surroundings in 
360 degrees; 

N cameras each associated with a different side of said N-sided 
reflective surface, and ajjaned tg_to^ 

between virtual centers of projection relati ve to each oth er which 
provide s minimal parall ax , erior_ .at,.a^pred^efined . d istance from the 
cameras , each of N cameras aligned to capture a reflected image in 
its associated reflective surface; and 

an image stitcher for stitching each of said reflected images 
taken by adjacent cameras together to create a panoramic image, " 
{emphasis added) 

And, 

"A process of capturing video for teleconferencing and meeting 
recording, comprising the following process actions: 

capturing images of an event in 360 degree with an omni- 
directional camera array, wherein said omni-directiona! camera 
comprises an N-sided mirror located above N cameras arranged to 
be equally spaced around the circumference of a circle in a 
circular fashion and tilted upward slightly from the horizontal 
plane, and positioned to have a small non-zero distance between 
their virtual centers of projection so as to provide minimal 
parallax error at a predefined distance from the cameras, each 
capturing an image reflected in a different side of said N-sided mirror; 
and 

stitching together said images captured by each of N cameras 
using a calibration surface to create a composite image," (emphasis 
added) 



And, 



"A computer-readable medium having computer-executable 
instructions for viewing or recording a video-conference, said computer 
executable instructions comprising: 

capturing images of persons in an event with an camera, 
wherein said camera comprises an N-sided mirror located above N 
cameras arranged to be equally spaced around at least a portion of a 
circle, such that said N cameras have a non-zero virtual center of 
projection so as to provide minimal parailax error at a predefined 
distance from the cameras, and tilted upward slightly from the 
horizontal plane, each capturing an image reflected in a different side 
of said N-sided mirror; and 

stitching together said images captured by each of N cameras 
using a calibration surface to create a composite image." (emphasis 
added) 

D. The 35 USC 103 Rejection of Claim 24. 



Claim 24 was rejected under 35 USC 103(a) as being unpatentable over Nalwa. 
No other reference was cited. The Examiner contended that though Nalwa does not 
teach building a viewer which does not provide a full 360 degree view, this feature 
would have been obvious to one of ordinary skill in the art (official notice was taken). 
The applicants respectfully disagree with this contention of obviousness. 



In order to deem the applicants' claimed invention unpatentable under 35 USC 
103, a prima facie showing of obviousness must be made. To make a prima facie 
showing of obviousness, all of the claimed elements of an applicants' invention must be 
considered, especially when they are missing from the prior art. If a claimed element is 
not taught in the prior art and has advantages not appreciated by the prior art, then no 
prima facie case of obviousness exists. The Federal Circuit court has stated that it was 
error not to distinguish claims over a combination of prior art references where a 
material limitation in the claimed system and its purpose was not taught therein {In Re 
Fine, 837 F.2d 107, 5 USPQ2d 1596 (Fed. Cir. 1988)). 

As discussed above, the applicants' claimed invention is a camera system 
that uses N cameras and an N sided mirror to capture images of the surrounding 
scene. The images from the N cameras are stitched together to create a 380- 
degree panorama using a calibration surface. The camera system uses the N- 
sided mirror to create a camera array with a very small dis tance D between the 
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virtual centers of projections of the cameras in the array so as to provide 
minimal p arallax error at a p r edefined distance from the cam er as. T his 
distance D is a non-zero value, however. (Summary, emphasis added) 

In contrast, Nalwa teaches a camera system comprising an N-sided reflective 
surface (40) and N cameras (52, 54, 55 and 58). Nalwa teaches tha t the cameras 
are aligned so that the have the sam e virtual center , as cited by the Examiner 
on page 2 of the Office Action, last paragraph. 

Nalwa does not teach the applicants' claimed N cameras each associated 
with a different side of an N-sided reflective surface, and aligned to have a small 
distance between virtual centers of projection relativ e to each other which 
provides minimal p arallax bto If 
each camera had an identical virtual center of projection, as is the case in NaSwa, it 
would be necessary to use large mirrors. Large mirrors are undesirable for video- 
conferencing purposes as the camera array should be very small and unobtrusive 
when it sits in the center of a conference room table. 

Additionally, the Nalwa reference does not teach the advantageous features of 
the applicants' claimed invention such as being to build a small camera with small 
reflective surfaces so that it is unobtrusive and suitable for video conferencing 
purposes, Accordingly, no prima fade case of obviousness has been established in 
accordance with the holding of In Re Fine. This lack of prima facie showing of 
obviousness means that the rejected claims are patentable under 35 USC 103 over 
Nalwa. As such, it is respectfully requested that Claim 24 be allowed based on the 
following claim language: 

" ...capturing images of persons in an event with an camera, 
wherein said camera comprises an N-sided mirror located above N 
cameras arranged to be equally spaced around at least a portion of a 
circle, such that said H cameras have a non-zero virtual center of 
projection so as to provide minimal paralla x error at a predefined 
distance from the cameras, and tilted upward slightly from the 
horizontal plane, each capturing an image reflected in a different side 
of said N-sided mirror... " (emphasis added) 
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E. 



The 35 USC 103 Rejection of Claims 10 and 18. 



Claims 10 and 16 were rejected under 35 USC 103(a) as being unpatentable 
over Nalwa in view of Mancuso et ai (U.S. Patent No. 8,677,981 }, herein after Mancuso. 
The Examiner contended that though Naiwa does not teach the use of a user defined 
calibration surface, Mancuso teaches this feature. The applicants respectfully disagree 
with this contention of obviousness. 

As previously discussed, the applicants' claimed invention uses an N-sided 
mirror to create a camera. array .with. a ye ry.smali..djMagce...P. between the virtual 
centers of projections of the cameras in the array s o as to provide minimal 
parallax error at a predefined..^ This distance D isa. 

nori-zero va_^ emphasis added) 

in contrast Nalwa teaches a camera system employing an N-sided reflective 
surface and N cameras. Nalwa teaches that the camera s are aligned so that the 
have the same virtua l center, as cited by the Examiner on page 2 of the Office 
Action of December 18, 2008, last paragraph. 

Nalwa does not teach the applicants' claimed N cameras each associated 
with a different side of an N-sided reflective surface, and ajjgn ed to ...have ;..a..s.majj 
distance between virtu al centers of projection .relative -to ,,each_ other which 
provides minimal parallax error at a ..predefined distance from theeameras. 

Mancuso also does not teach the the applicants' claimed N cameras each 
associated with a different side of an N-sided reflective surface, and aligned to 
have a sm all dista nce between virtua l centers of projec tion Ljgjatiye to each 
other which provides minimal parallax e rror at a predefined distance from the 
cameras . 
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Accordingly, Nalwa in combination with Mancuso does not teach the applicants' 
claimed the applicants' claimed N cameras each associated with a different side of an 
N-sided reflective surface, and aligned to hay© a small distance between vi rtual 
centers , pf projection relative to each other which provides minimal parallax error 
at a predefined distance from the cameras . Nor does Nalwa in combination with 
Mancuso recognize the advantages of the applicants' claimed invention, such as the 
being abie to creat a small video conferencing camera which provides minimal parallax 
error at a predefined distance from the cameras. 

Thus, the applicants have claimed elements not taught in the cited art and which 
have advantages. Accordingly, no prima facie case of obviousness has been 
established in accordance with the holding of In Re Fine. This lack of prima facie 
showing of obviousness means that the rejected claims are patentable under 35 USC 
103 over Nalwa in view of Mancuso. As such, it is respectfully requested that Claims 
10 and 16 be allowed based on the aforementioned quoted claim language. 

F. The 35 USC 103 Rejection of Claims 11, 12, 15, 18 and 25. 

Claims 1 1 , 12, 15, 18 and 25 were rejected under 35 USC 103(a) as being 
unpatentable over Nalwa in view of Foote el aS (U.S. Patent No. 7,01 5,954), herein 
after Foote. The Examiner contended that though Nalwa does not teach the method of 
combining the images as taught by Claim 1 1 , Foote teaches this feature. The 
applicants respectfully disagree with this contention of obviousness. 

The applicants' claimed invention uses the N-sided mirror to create a 
camera array with a very smaH distance D betwee njhe ..vjrtu alce piers of 
projections of the cameras in the array so as to pr ovide mjnirnal parajfaxjs rro r 
at a predefined distance from the camer as. This distance DJsajioj>g§ro 
value, however. ( Summary, emphasis added) 

In contrast Nalwa teaches a camera system comprising an N-sided reflective 
surface and N cameras wherein the cameras are aligned so that the have the 
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same virtual center , as cited by the Examiner on page 2 of the Office Action, 
test paragraph, 

Naiwa does not teach the applicants' claimed N cameras each associated 
with a different side of an N-sided reflective surface, and aligned to have a small 
distanc e between virtual centers of projection relative to each gther whjcji 
provides minimal parallax error at a p redefine d distance from the cameras . If 
each camera had an identical virtual center of projection, as is the case in Naiwa, it 
would be necessary to use large mirrors. Large mirrors are undesirable for video- 
conferencing purposes as the camera array should be very small and unobtrusive 
when it sits in the center of a conference room table. 

Foote also does not teach the the applicants' claimed N cameras each 
associated with a different side of an N~sided reflective surface, and ali gned to 
have a small distance between virtu al centers of projection relative to each 
M h£r,V vn ' c h,Pnnr oyMes minimal parallax error at a predefined distance fro m the 
cameras. 

Accordingly, Naiwa in combination with Foote does not teach the applicants' 
claimed the applicants' claimed N cameras each associated with a different side of an 
N-sided reflective surface, and aji gnedjo have a small distance between \MyM 
centers of projection relative to each other which provid es minimal parallax : error 
at a prede fined dist ance from the cameras . Nor does Naiwa in combination with 
Foote recognize the advantages of the applicants' claimed invention, such as the being 
able to creat a small video conferencing camera which provides minimal parallax error 
at a predefined distance from the cameras. 

Thus, the applicants have claimed elements not taught in the cited art and which 
have advantages. Accordingly, no prima facie case of obviousness has been 
established in accordance with the holding of In Re Fine. This lack of prima facie 
showing of obviousness means that the rejected claims are patentable under 35 USC 
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1 03 over Nalwa in view of Foote, As such, It is respectful iy requested that Ciaims 1 1 , 
12, 15, 18 and 25 be allowed based on the aforementioned quoted claim language. 

G- The 35 USC 103 Rejection of Claims 4 and 21.. 

Claims 4 and 21 were rejected under 35 USC 103(a) as being unpatentable over 
Nalwa in view of Yoshikawa (U.S. Patent No. 7,116,351), herein after Yoshikawa. The 
applicants respectfully disagree with this contention of obviousness. 

The applicants' claimed invention is a camera system that uses N cameras 
and an N sided mirror to capture images of the surrounding scene. The images 
from the N cameras are stitched together to create a 360-degree panorama using a 
calibration surface. The camera system uses the N-sided mirror to create a 
camera array with a very small distance D between the virtual centers of 
gro lectiqr i s of the cameras in the array so as to p r ovide minimal parallax error 
at a predefined dist ance from the cameras. This d istance D is a non-zero 
value, however. ( Summary, emphasis added) 

In contrast, Na!wa teaches a camera system comprising an N-sided reflective 
surface (40) and N cameras (52, 54, 55 and 58). Nalwa teaches that the cameras 
are aligned so that the ?, have the ..sam_e__yi_rtuaj__c„ente„r . as cited by the Examiner 
on page 2 of the Office Action, last paragraph. 

Nalwa does not teach the applicants' claimed N cameras each associated 
with a different side of an N-sided reflective surface, and aliened, to have a small 
distance between virtual ce nters of projection relative Jo :.e_ach.other which 
provides minimal parallax er ror at a predefined distance from the cameras . If 
each camera had an identical virtual center of projection, as is the case in Nalwa, it 
would be necessary to use large mirrors. Large mirrors are undesirable for video- 
conferencing purposes as the camera array should be very small and unobtrusive 
when it sits in the center of a conference room fable. 
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Yoshikawa also does not teach the the applicants' claimed N cameras each 
associated with a different side of an N-sided reflective surface, and aligned to 
have a s mall distance between virtual centers of projection relative to each 
other which provides minima i paraHax error at a p redefined distance from the 
cameras . 

Accordingly, Naiwa in combination with Yoshikawa does not teach the 
applicants' claimed the applicants' claimed N cameras each associated with a different 
side of an N-sided reflective surface, and aligned t o have a small distance between 
virtual centers of projection relative to each other which provide s minimal 
pa ra Hax e rror at a .predef j ned. djstan^ Nor does Nalwa in 

combination with Yoshikawa recognize the advantages of the applicants' claimed 
invention, such as the being able to creat a small video conferencing camera which 
provides minimai parallax error at a predefined distance from the cameras. 

Thus, the applicants have claimed elements not taught in the cited art and which 
have advantages. Accordingly, no prima facie case of obviousness has been 
established in accordance with the holding of in Re Fine. This lack of prima facie 
showing of obviousness means that the rejected claims are patentable under 35 USC 
103 over Nalwa in view of Yoshikawa. As such, it is respectfully requested that Claims 
4 and 21 be allowed based on the aforementioned quoted claim language. 
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Summary 



In summary, it is believed that the claims 1-22 are in condition for allowance. 
Allowance of these claims at an early date is courteously solicited. 



LYON & HARR, LLP 

300 Esplanade Drive, Suite 800 

Oxnard, CA 93036 

(805) 278-8855 



Respectfully submitted, 



Katrina A. Lyon 
Registration No. 42,821 
Attorney for Applicants 
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